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Abstract 



It is shown that the Tsallis entropies are the only entropies of the 
form H(P) — — f(pi), with suitable assumptions on /, satisfying the 
condition of composability. 
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1 Introduction 

We define the /-entropy as in p] (see also [2] for some basic properties), namely, 
we demand that / is a real-valued analytic and strictly convex function on 
[0, oo), that it satisfies /(0) = /(l) = 0, and lastly, that it is normalized so that 
/'(l) = 1. The /-entropy is then defined as 



where P — (pi,p2,-.-) is a probability distribution on A. Unless explicitly 
stated otherwise we shall assume that A = N. 

Simple considerations show that for any probability distribution P, < 
H f {P) < -/'(0) and that sup{H f (P)\P} = -/'(0). Thus g in © need only be 
defined on [0, -/'(0)[x [0, -/'(0)[. 

The purpose of this paper is to show that the Tsallis entropies are the only 
/-entropies that are composable, i.e. satisfy the equation 



for some function g and all probability distributions P, Q. The possible forms 
of the function g for general measures of entropy is considered in the articles 
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(1) 



H f (P®Q)=g(H f (P),H f (Q)) 



(2) 



[SI lllj . The relation between non-additive and additive entropies is explored in 

The Tsallis entropies were first considered in the mathematical literature in 
[5] and then later (and independently) in statistical physics by C. Tsallis in [3]. 
They are defined for any q > as the /-entropy associated with the function 



It is not hard to see that the Tsallis entropies in fact satisfy the equation 

H q {P (8 Q) = H q {P) + H q (Q) + (1 - q)H q (P)H q (Q). (3) 

Our first theorem is the converse: Any /-entropy satisfying an equation of this 
type must be a Tsallis entropy. Having proved that, we can extend the result 
to cover /-entropies satisfying the more general equation ([2]). 

The paper [BJ addresses the same issue as here. Let us briefly describe 
how the present work differs in outlook. In [BJ, the "non-obvious" assumptions 
needed are the existence of /'(0) as well as either that of / being a sum f(x) = 
Ssomc q's>i xa( f>a( x ) or an assumption of analyticity on g. 

Assuming the existence of /'(0) seems rather limiting, recalling that for the 
shannon entropy, (a; log a;)' indeed does not exist for x — 0. As for the other two 
assumptions, it is not at all a priori clear how restrictive they are in physical 
terms. 

It seems much more natural to take an important physical property of the 
entropy, in our case concavity (which is equivalent to the convexity of /), and 
starting from there. This gives a precise result, which seems to have exactly the 
right relevance for physical applications. 



2 Composability of /-entropy 

Theorem 1. If the f -entropy satisfies 

H f (P ® Q) = aH f (P) + 0Hf{Q) - 1 H f (P)H f (Q), (4) 
for constants a, (3, 7 and all probability distributions P, Q, then a = /3 = 1, and 
f(xy)=xf(y)+yf(x)+ 7 f(x)f(y) (5) 

for all x, y > 0. 

For a more general version of this theorem, see for example [7] . We give an 
elementary 

Proof. Plugging in the definition of the /-entropy, we get that for all probability 
distributions P = (pi), Q = (Qj), 

YsftPiQi) =«E/W +/ 3 E^fe) + 7£/(Pi)/G&)- (6) 

i,j i 3 hj 
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Letting Q be deterministic yields a = 1 and P deterministic yields = 1. For 
uniform distributions P = U m and Q = U n , we then find from ([6]) that 

/( — ) = -/(-) + -/(-) + 7/(-)/(-), (7) 
ran m n n m m n 

that is, / satisfies (J5j) for all x = — , y — — . We seek to extend this to all rational 
numbers in [0, 1], which then extends to all x,y € [0, oo) by the analyticity of /. 

Let q £ [0, 1] fl Q and choose a, m £ N such that q + = 1. Applying © 
to P= (q, ^,...,i,0,...) and Q = U n , we get 

n/(£) + anf(-) = /(g) + a/(l) + n/(i) + 7 f /(?) + «/(-)) nf(-), 
n mn m n \ m ) n 

and so using the above result on the term cmf(-^^) and remembering that 
— = 1 — q, we get 

/(-)=9/(-) + -/(<z)+7/(9)/(-)- (8) 
n n n n 

Finally, letting also re [0, 1] fl Q and choosing J,n £ H such that r + b~, we 
apply fBJ) to Q = (r, 0, ... ) and P as above, getting 

/(«r) + &/(-) + «/(-) + a6/(— ) = /(g) + a/(l) + f(r) + bf(-) + 
n m mn m n 

+7 (f(q)+af(-)) ff(r)+bf(-) 
\ m J \ n 

Using ([8]) and on the left-hand terms we get that 

f(qr)=qf(r)+rf(q)+ 1 f(q)f(r). (9) 

Since this holds for all q,r £ [0, 1] fl Q, the theorem follows by analyticity of 
/■ " //// 

That this does indeed provide a converse to ([3]), is shown by the following 

Corollary. If the f -entropy Hf satisfies the conditions of the theorem, then Hf 
is a Tsallis entropy: Hf = H q for some q > 0. 

Proof. In [I] it is shown that if / satisfies the factorization property 

W) =£e(Pi)C(?i), 

\ "i J 

where £, £ are analytic functions on [0, oo[ satisfying £(1) = 1 and £(1) = 0, then 
the /-entropy is a Tsallis entropy. 
Well, we have by the theorem that 

<&/(-) - fiPi) = (Pi + 7/(Pi))*/(-), (10) 
ft q% 

hence the result follows. //// 
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Before we can tackle the general problem, we need to note an important 
property of /-entropy. Namely, let Q = (qi)i<N G M;}.(iV jj with say, < q\ < 
q 2 < 1, and consider also the distribution Q e — (qi — e, q 2 + e, 03, . . . , gjv). If e 
is sufficiently small and negative - more precisely, if h (qi — q 2 ) < £ < 0, we have 
that the entropy of Q e is strictly greater than the entropy of Q. Similarly, if e 
is sufficiently small and positive - more precisely, if < e < q±, the entropy of 
Q e will be strictly smaller than that of Q. This follows by the strict convexity 
of/. 

Together with the continuity of Hf on Mi_(N), this implies that the mapping 
e r\ Hf(Q £ ) is a homeomorphism of the interval [hill — 92)1 Qi] onto the interval 
[H f (0,q 2 + qi,q 3 , . . .,q N ),Hf(\{q x + q 2 ), \{qi + g 2 ),<73, ■ ■ ■ ,9jv)]- 

Lemma 2. Let < a < b < — /'(0). T/ien ttere exists N G N, and 51,92 wifft 
< <7i < Q2 < 1 such that 

[a,b]C{H f (Q)\Q = (q 1 ,q 2 ,q 3 ,...,q N )GM({l,...,N})}. (11) 

The point of this is, that we can fix N, q%, q 2 once and for all, and still have 
enough probability distributions to "calculate with g(x,y)" with x,y £]a,b[. 

Proof. Since the sequence (—nf(—)) is increasing and converges to — /'(0) (in- 
deed, by definition /'(0) = liniyj^oo nf(—)), all N sufficiently large will satisfy 

b<-(N-l)f( 1 ^-j) = H f (U N - 1 ). (12) 

So, from the remarks above, it is clear that by choosing N sufficiently large and 
q~i + h = jvf3i> with < qi < q 2 , we get 

Hf {qi, q 2 , 1 - qi - fa) < a < b < Hf(U N -\) < H f (qi,fa, N \ j^- 1 

(13) 

The lemma then follows since we can get the right-hand entropy from the left- 
hand one by continuously pulling probabilities together, as in the remarks above. 

//// 

Theorem 3. Assume that the f -entropy Hf satisfies the condition of compos- 
ability as in eq. 0) for some function g defined on [0, — /'(0)[x [0, — /'(0)[. Then 
g has partial derivatives on ]0, — /'(0)[x]0, — /'(0)[, and indeed 

g(x,y)=x + y + -fxy, x,y G [0, -/'(0)[, (14) 

for some constant 7. 

Proof. We want to show that on all sets ]a, b[x]a, b[ with < a < b < — /'(0), 
the partial derivatives exist and satisfy 

d d 
-Q^g{x,y) = A(y), —g(x,y) = B(x). 



"For N £ N we write M]_(N) for the set of probability distributions on {1, . . . , TV}. 
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The theorem then easily follows. 

So, for given a, b choose N, q±, q 2 as in the lemma. Let x, y s]a, 6[ and choose 
P,Q= (qufa, 93, ••• , Siv) G M|(iV) such that 

H f (P)=x, H f (Q)=y. 

If 2M ~~ > 2/ f° r some sequence (y n ), we can assum^j] that there exists a sequence 
(e„) such that for all n 

y n = H f (Q £n ) = (q 1 - e n , q 2 + £„, 93, • • • , «?jv), and lim e n = 0. 

As 

g(x,y n )-g(x,y) g(H f (P), ff/(Q E J) - g(H f (P), H f (Q)) 

Vn-y ~ H f (Q Sn )-H f (Q) 

H s (P®Q en )-H f {P®Q) 
H f (Q En ) - H f (Q) 

and as 

H f {P®Q £n )-Hf{P®Q) 

n^L- Hf(Q En ) - Hf(Q) 

lim [/(Ml) _ /(P»(?i - + /(P<?2) - f{jPi{h + £«))] 



" - x /(<7l) - /(<Zi - £n) + /(<&) - /(?2 + £n) 

lim Y^Pi 

l— >oc * — • 



n — >oc 

i=l 



- SnPi) - fiPiQl) fiPifa + SnPi) ~ f{Pifa) 



f(qi - En) - f(qi) f(fa + e n ) - f{fa) \ _1 



iV 

we find that J^g(x,y) exists and that 

^g(x,y) = (/'(&) - f{q 2 ))- 1 ^Piifimi) f'ipih))- (15) 

dy fr{ 

But since q~\ and q 2 are the same for any choice of y, it is independent of this 
choice - i.e. 

d 

g-g(x,y) = B(x), for aHx,y G]o,6[. (16) 

Completely analogously it is shown that the partial derivative with respect to 
x exists and that 

d 

g^g(x,y) = A(y), for all x,y e]a,b[. (17) 



^By leaving out finitely many of the 2/ n 's if we have to, and using that the mapping 
e r\Hj(Q e ) is a homcomorphism of intervals as remarked above. 
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Since a and b were arbitrary, it follows that 

g(x,y) = C + ax + f3y + 1 xy, x, y G]0, -/'(0)[, (18) 

and the theorem follows by the continuity of Hf on finite distributions - in 
particular we have for P = (p, 1 — p) and Q = (g, 1 — q), < p,q < 1, 

H f {P) = KmH f (P®Q) 

= lim [C + aH f (P) + (3H f (Q) + 7 H f (P)H f (Q)} 
= C + aH f (P), 

so C — and (after analogous argument for [3) a = (3 = 1, which shows the 
validity of the theorem for all x, y G [0, — /'(0)[. //// 

Comparing theorem [3] with the corollary of theorem [1] we see that any /- 
entropy which is composable is indeed a Tsallis entropy. 



3 Discussion 

The condition of composability is important in thermodynamical applications of 
entropy and we have shown here that any /-entropy which is composable must 
be a Tsallis entropy. Thus, for example, we see that attempts of 2-parameter 
generalizations of Tsallis entropy as in [H [2] as well as many suggestions of 
alternate entropy functions such as the well known Kaniadiki^] entropy will not 
be able to satisfy the condition of composability. 

More generally, entropy is often defined as a function H(P) = </?(— J^i f(Pi))> 
i.e. as a function of /-entropy, where ip is positive and strictly increasing. In 
particular, ip is bijective, and our theorem shows that if H is composable, then 
it is in fact a function of some Tsallis entropy. A well known example is the 
Renyi entropy defined for a > by 



H a (P) = 




It is an interesting question whether there exists one choice of transformation 
ip which in some sense is better than any other choice. If so, one would expect 
that either Tsallis or Renyi entropy pops up. For this question, F. Tops0e 
suggested that his notion of game theoretical equilibrium might be relevant (see 
[5] for details). In [S] it is shown that the Renyi entropy lacks certain physically 
important properties that the Tsallis entropy posses. 

* more generally, any linear kombination of Tsallis entropies that does not give a new Tsallis 
entropy. 



G 



Acknowledgments 



I am indebted to Flemming Tops0e for good advice, insightful discussions con- 
cerning both the present work and more general game and information theory, 
and not least for support. Also, Robert Niven for some helpful advice. 



References 

[1] F. Tops0e. Factorization and escorting in the game-theoretical approach to 
non-extensive entropy measures. Physica A, 365 (2006), 91-95. 

F. Tops0e. Entropy and Equilibrium via Games of Complexity. Physica A, 
340 (2004), 11-31. 

C. Tsallis. Possible generalization of Boltzmann-Gibbs statistics. J. Stat. 
Physics, 52 (1988), 479-487, 1988. 

See |http://tsallis.cat.cbpf.br/biblio.htm] for a complete and updated bibli- 
ography. 

V. Schwammle, C. Tsallis. Two-parameter generalization of the loga- 
rithm and exponential functions and Boltzmann-Gibbs-Shannon entropy. 
arXiv:cond-mat/0703792vl [cond-mat.stat-mech]. 

J. Havrda, F. Charvat. Quantification method of classification processes. 
Concept of structural a-entropy. Kybernetika, 3 (1967), 30-35. 

M. Hotta, I Joichi. Composability and generalized entropy. Physics Letters 
A, 262 (1999), 302-309. 

S. Abe. Axioms and uniqueness theorem for Tsallis entropy. Physics Letters 
A, 271 (2000), 74-79. 

S. Abe. General Pseudoadditivity of composable entropy prescribed by the 
existence of equilibrium. Physical Review E, 63 (2001), 061105. 

S. Abe. Tsallis Entropy: How unique? arXiv:cond-mat/0305087vl [cond- 
mat.stat-mech]. 

R.S. Johal. Additive entropy underlying the general composable entropy 
prescribed by thermodynamic meta-equilibrium. Physics Letters A, 318 
(2003), 48-52. 

R.S. Johal. Composable entropy and deviation from macroscopic equilib- 
rium. Physics Letters A, 332 (2004), 345-349. 



7 



